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In this article we develop a new methodology to prove weak ap- 
proximation results for general stochastic differential equations. In- 
stead of using a partial differential equation approach as is usually 
done for diffusions, the approach considered here uses the properties 
of the linear equation satisfied by the error process. This methodol- 
ogy seems to apply to a large class of processes and we present as an 
example the weak approximation of stochastic delay equations. 

1. Introduction. The Euler scheme for stochastic differential equations 
is widely used in applications as it is easy to compute. The Euler scheme 
can be easily generalized to a variety of stochastic equations beyond the 
framework of diffusion equations, in particular Volterra SDEs, delay SDEs, 
anticipating SDEs and nonlinear SDEs. 

On the other hand, the theoretical properties of the Euler scheme are 
mostly studied for the diffusion case as most of the results available so far 
are in this framework. In some cases, extensions to other similar equations 
are straightforward but in other cases, additional nontrivial work is required. 
For example, see [8] for extensions to semimartingales, and [1, 11] for ap- 
proximations of an irregular functional of a diffusion which is approached 
using a Euler type scheme. It is also well known that the definition of an 
extension of the Euler scheme for delay type systems is straightforward but 
the technical results on the weak rate of convergence are limited. See [4, 6, 9]. 

In this article we propose a generalization of the theory of weak approxi- 
mations which studies the rate of convergence of the Euler scheme considered 
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in law. This generalization finds as an application the weak rate of conver- 
gence of smooth functionals of general delay type systems and also covers, 
with a further study of the Malliavin covariance matrix, the case of irregular 
functions of the solution of the stochastic equation. 

The main idea is to change completely the approach used until now to 
prove weak approximation rate results. This new idea, which uses the whole 
path of the process under study rather than the partial differential equation 
associated to the problem, should allow to obtain various other straightfor- 
ward generalizations of results of the weak rate of convergence. 

In order to describe our approach roughly, let X denote the solution of a 
stochastic equation and X the Euler scheme associated to it. The problem 
of weak rate of convergence consists in finding the rate at which E{f{X) — 
f(X)) converges to zero for various classes of functionals /. The optimal 
rate is the step size of the scheme even though the equations considered 
may differ. 

The classical proof of this result for diffusions is based on the associated 
partial differential equation, that is, Ef(X) has through the Feynman-Kac 
formula an interpretation using PDEs. This is the important point in the 
classical approach which is not used in our approach. In the case of some 
stochastic equations, if / is regular enough, the proof is similar if the as- 
sociated PDE exists. If / is an irregular function, then the issue of the 
nondegeneracy of the Malliavin covariance matrix of the Euler scheme be- 
comes an important issue as has been shown in [1, 11], but this extension is 
nontrivial. 

In this article we propose a completely different method to prove weak 
approximation results based on a pathwise approach. That is, we use the 
mean value theorem to rewrite f(X ) — f(X) = Jq f'(aX + (1 — o)X) da(X — 
X). Then, we derive a linear equation satisfied by Y = X — X . When this 
equation can be explicitly solved, which seems to be true only for diffusions, 
one can obtain the rate of convergence by using the duality property of 
stochastic integrals. This methodology was first introduced by Kohatsu-Higa 
and Pettersson [7] and used in Gobet and Munos [5]. It seems to be quite 
general except for the explicit expression for Y which can be done only in the 
case of diffusions. This article presents a general framework to analyze weak 
approximations in stochastic equations. In particular we solve the problem 
without having an explicit expression for the solution of stochastic linear 
equations, by using a duality argument. This duality formula (see Section 
3) shows explicitly the weak error as a by-product of the expectation of an 
error process (called G in Section 3). To finish the proof one has to use 
the duality formula for stochastic integrals. Therefore our approach works 
mostly for stochastic equations with regular coefficients. For this reason we 
have to study the stochastic derivatives of the solution process. It should be 
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emphasized that this approach applies to regular functionals of the process 
X and not only to functions of the value of X at a fixed time t. 

Furthermore, the framework introduced here also extends naturally to 
the case of irregular functions /. That is, one uses the integration by parts 
formula of Malliavin calculus to regularize the function /. We believe that 
this approach for the irregular case follows naturally from the regular case. 
It also explains clearly that to obtain the result for the irregular case is just 
a matter of studying the nondegeneracy of the limiting stochastic process 
and not the approximating process. 

In order to show what are the elements in each theorem we also consider 
as an example a delay type equation which does not have a clear associated 
PDE in order to extend the classical proof. The general framework is directly 
applied, which gives the weak rate of convergence. 

This article is organized as follows. In Section 2 we present the example 
of a diffusion process to introduce the methodology. Section 3 contains the 
main results in the general framework and an application to the weak rate 
of convergence of approximations of delay equations for regular functions. 
These results are then extended to irregular functions in Section 4. 

2. The case of one-dimensional diffusions. To clarify the methodology, 
we consider a smooth function a and a Wiener process W and a real diffusion 
process 



where rj(s) = kT/n for kT/n < s < (k + l)T/n. The error process Y = X — X 
satisfies 



Jo 

Its Euler approximation is given by 
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In this simple case we have an explicit expression for Yj: 

Y t =8 t [ t S- 1 (dG s -a 1 (s)d(G,W) s ), 
Jo 

where S is the unique solution of 

St = l+ [ <ri(s)£ 8 dW 8 . 
Jo 

Finally we obtain 

Y t = £ t /'* 1 g s -V 1 ( S ) ( 7(X 77(s) )(W s - W„ w ) dW s 

J 

- St f ' S^axisfaiX^Ws - W v{s) )ds. 



Now let / be a regular function. We are interested in the determination of 
the rate of convergence of E/(Xt) to E/(Xy). We first write the difference 

Ef(X T ) - Ef(X T ) = E f 1 f'(aX T + (1 - a)X T ) daY T . 

Jo 

Replacing Yt by its expression, we obtain with the additional notation F h = 
fSf'(aXT + (l-a)X T )da, 

EF h Y T = EF h S T f Sj 1 a 1 {s)a{X ri{s) )(W s - W v(s) )dW s 

(2) ° T 

- ^F h S T J Q S^axisfaiX^iW, - W v{s) )ds. 

Applying the duality for stochastic integrals, this gives 

EF h Y T =E D s {F h S T )S- 1 a 1 {s)a{X ri{s) ){W s - W v[s) )ds 

-EF h S T £ S^axisfaiX^Ws-W^ds, 



where D denotes the stochastic derivative. Consequently, the difference E/(Xt) 
E/(Xt) can be written as 

Ef{X T ) - Ef(X T ) = E^ U^(W s - W v(s) ) da, 

with 

= (D s (F h S T ) - F^TcriisMS^axisWX^)). 
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We finally obtain the rate of convergence by applying once more the duality 
for stochastic integrals 

E/(X T ) - Ef(X T ) = E [ T f D u U^duds. 

JO Jr]{s) 

This last formula makes clear that \E/(Xt) — E/(Xt)| < ^Y n an d leads to an 
expansion of Ef(Xx) — E/(Xt) with some additional work (see Section 3). 

In other stochastic equations, the error process also satisfies a linear equa- 
tion [similar to (1)] but in a more general form; see Section 3.4. The aim 
of the next section is to establish a formula (called the duality formula) 
which will be a substitute for (2) when the error process Y does not have 
an explicit expression. 

3. Duality for the error process and application to delay equations. 

3.1. General form of the error process equation. Throughout the paper, 
we consider a complete probability space (Q,J-,¥), which is the canon- 
ical space of a d-dimensional Brownian motion with finite horizon W = 
{(W/, . . . , Wf), < t < T}. We denote by F = (J r t) <t<T the usual augmen- 
tation of the natural filtration of W. If if is a separable Hilbert space and 
p G [1, +oo), we denote by I^([0, T];H) the space of all measurable adapted 
processes X = (X t )o<t<T, with values in H such that E Jq \X t \ p dt < oo, 
where | • | denotes the norm on H. 

Recall that according to the ltd representation theorem, any if-valued 
random variable X such that E|X| 2 < oo can be written in the following 
form: 

X = E(X) + Y, f J l s (X)dWl, 
i=i Jo 

where J l (X), J d {X) G L 2 a ([0, T]; H). Note that this defines J 1 ,...,^ 
as linear operators mapping I?{Tt\H) into L^([0,T]; H). We will often 
use the notation J(X) for the vector (J l (X), . . . ,J d (X)) and Z ■ dW for 
EtiZ i dW\ 

We consider ax, . . . , a^, 0, d + 1 linear continuous operators on the Hilbert 
space £„([0, T]; H). The aim of Section 3.1 is to study the following gener- 
alization of (1): 

(3) Y t = Y; f ai(Y)(s)dWi+ f (3{Y){s)ds + G u 0<t<T, 
i=1 Jo Jo 

where G e L 2 a ([0,T}; H). 

In fact, the study of (3) in the space L\ will not be sufficient (see Sec- 
tion 3.4) and we will need L p -estimates for p large enough. For simplicity 
we state the assumption as follows. 
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Assumption Al. For every p>2, there exists a positive constant C p 
such that, for all t G [0,T], Y € L p ([0, T]; H), 

r t( d \ p / 2 rt f t 

(4) E ^ ^|ai(F)(s)| 2 J ds + E^ |/?(y)(s)| p ds<C p E ^ |y s | p &. 

Proposition 1. Let Assumption Al /ioW and let p>2. Given G G 
L^([0, T]; i?), f3,) /ias a unique solution Y G £^([0, T]; ff) and we /iaue 

E [ T \Y t \ p alt < C P E [ T \G t \ p dt, 
Jo Jo 

for some constant G p depending on C p (and T) only. 

Proof. Let A; be a positive real number. We define an equivalent norm 
|| • \\k on the space L p ([0,T];H) by setting 

||Y||P=E [ T e- kt \Y(t)\ p dt. 
Jo 

Let A and B be the operators defined by 

(5) A(Y)(i) = ]T f a t {Y){s)dWl, 

(6) B(Y)(t)= f P(Y)(s)ds. 



We have, using the Burkholder-Davis-Gundy inequality (BDG inequality 
in the sequel) and p>2, 

\\A(Y)\\l = E F dte- kt Y.f ai {Y){s)dW t 
Jo f^Jo 

<K P ^J Q dte- kt U^Y,\ a i( Y )( s )\ 2ds ) 



<K„E dte-^tP/ 2 - 1 



i=i / 

p/2 



t / d \ P/ 1 

l (ll\<Xi(Y)(s)\ 2 j ds 



< KpCpTP^E I dte~ kt I ds\Y,\ p 



where the constant K p comes from the BDG inequality and C p from As- 
sumption Al. Using Fubini's theorem, we derive 

(7) \\A(Y)\\l <^ \\Yf k . 
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A similar argument leads to 
(8) \\B(Y)\\l<^\\Y\\l. 

It follows that, for k large enough, the operator A + B is a contraction for the 
norm || • ||^. Hence, if I denotes the identity, the operator I— {A + B) (acting 
on LP([0,T];H)) is invertible and this implies existence and uniqueness for 
the solution of (3). □ 

Remark 2. Note that if the process G has right-continuous (resp. con- 
tinuous) paths, the solution of (3) has a right-continuous (resp. continuous) 
modification. This modification will still be denoted by Y. 

3.2. The duality formulae. The purpose of this section is to establish two 
duality formulae relating K(F,Yt) to Gt for F in L 2 (J7). We first introduce 
some notation. We denote by (•,•) the inner product on H. The operators 
A* :Ll([0,T];H) ^ L 2 a ([0,T];H) and B* :Ll([0,T];H) -+ L 2 a ([0,T];H) are 
the adjoints of the operators A and B defined by (5) and (6). If we set 
a(Y) = (ai(y), . . . , arf(y)), we can view a as a linear operator mapping 
the Hilbert space Ll([0,T};H) into L 2 a ([0,T];H d ). The adjoint operator a* 
maps L„([0, T]; H d ) into L 2 ([0,T];H). The following proposition relates the 
operators A* and B* to a* and f3*. 

Proposition 3. The operators A* and B* are given by 
A*(Z)(t) = ita*(j^J o T Z s ds^(t) 

B* (Z) (t) = (3* (e (^J T Z s ds\^ (t) . 

Proof. For all Y, Z £ L 2 a ([0,T];H), we have 

Ej\z t ,A(Y)(t))dt = Ej^J^Z t j\ i (Y)(s)dW^dt 

r - , Jo Jo 



i=l 



T f T ^ \ 

E j U £(Ji(Zt)MY)(s))dtjds. 
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Note that, since Z t is .^-measurable, we have J\{Zt) = for t < s. Hence, 
using the linearity of the operators J 1 , 

E^ (Z t ,A(Y)(t))dt = E^ U py i s (Z t ), ai (Y)(s))dt\ds 
= E ^ Py^l Ztdtj, ai (Y)(s)Jds 

which proves the formula for A*. We proceed similarly with B: 
E^ T (Z t , B(Y)(t)) dt = e£(z u 0(Y)(s) ds"j dt 

= eJ^J* Z t dt,p(Y)(s)\ds 



E Hf3* (e ^ Z t dt\f)j ) (a) , Y(s)\ ds. 



The next theorem states the two basic duality formulae. In order to relate 
E(&,Yr) to Gt, we need a formula for E (F t ,Y t ) dt when (F t )o<t<T G 
L 2 a ([0,T];H). 

Theorem 4. Let Ge Ll([0,T];H) and let Y be the solution of (3). 
1. IfF = (F t ) < t < T GL 2 a ([0,T];H), we have 



E / (F t ,Y t )dt = E f (9 t ,G t )dt, 
Jo Jo 



with 9 = (I — A* — B*)~ 1 (F). 
2. If G has a continuous modification, then Y has a continuous modifica- 
tion (which we still denote by Y), and if <3? is an Tt -measurable square 
integrable random variable with values in H , we have 

E<$, Y T ) = E<$, G T ) + E F {6 U G t ) dt, 

Jo 

with 

§ = (I-A*- B*) -1 [a*(J(*)) + (3*(E(<S>\F.))}. 

Proof. The first part of the theorem comes from the equality Y = 
(I — A — B)~ l (G) and standard duality theory. For the second part, it is 
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clear from (3) that if t \— ► G% is continuous, the process Y has a continuous 
modification. We also have 

E($, Y T ) = E($, G T } + E^$, j\{Y){s) ■ dW s + J (3(Y){s) ds^j . 

Now 



and 



e($J* p(Y)( s )ds^ =e £ (e($\f s ),/3(y)( s )) ds. 

Therefore 

E($,F T )=E($,G T >+E [ T (F s ,Y s )ds, 

Jo 

with F t = a*(J($))(*) + /?*(E($|.F.))(i). And the result follows from the first 
part. □ 

Remark 5. The processes and 9 given by Theorem 4 can also be 
characterized in connection with backward stochastic differential equations 
(BSDEs). First note that 9 satisfies the dual equation 

(9) 9 = F + A*{8) + B*(9), 
which, using Proposition 3, can be written 

(10) = F + a*(j(J 9 s dsyj + (3* s ds\T. 

Now, observe that, given 9 £ L 2 a ([0,T};H) and * <E L 2 (JT T ;i7), the pair of 
processes (Y,Z), defined by 



K = E *+ / 9 s ds 



T 



Ft) and Zt = J t / 9 s ds), 



T 



is the unique solution of the following BSDE: 

dY t = -9 t dt + Z t - dW t , 
Y T = t>. 

It follows that, if 9 satisfies (10), we have 

9 t = F t + a*(Z)(t) + p*(Y)(t), 
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where the pair (Y, Z) solves the following BSDE: 

dY t = -(F t + a*(Z)(t) + (3*(Y)(t)) dt + Z t - dW t , 
Y T = 0. 

Similarly, the process 9 in Theorem 4 is given by 

9 t = a*{Z)(t)+[5*{Y)(t), 
where the pair (Y, Z) solves the following BSDE: 

dY t = -(a*(Z)(t) + (3*(Y)(t)) dt + Zt- dW t , 

y T = $. 

3.3. Estimates for the stochastic derivatives of the dual equation. In this 
section we study the dual equation (9). We will establish estimates for the 
derivatives of the process 9 involved in the duality formulae. These esti- 
mates will be useful for the study of the weak rate of convergence of the 
Euler scheme for the computation of expectations of regular functions (see 
Section 3.4). Under Assumption Al, we know from Proposition 1 that the 
operator I — A — B is invertible when considered on the space ^([0, T];H) 
for p>2. The operators A* and B* can be viewed as bounded linear opera- 
tors on LP([0, T];H) for p<2, and it follows that the operator (I — A* — B*) 
is invertible on the space LP([0, T];H), for p < 2. 

In other words, we may assert that, given F S -£^([0, T];H) (with 1 < p < 
2), there exists a unique 9 G LP([0,T];H), satisfying 

9 = F + A*(9) +B*{6). 
Using Proposition 3, we have 



(11) 9 = F + a*(J[ 9 s ds ))+/3* E 



We want to differentiate this equation, in order to estimate the Malliavin 
derivatives of 9. We will need some regularity assumptions on the operators 
a and j3. For the basic theory of Sobolev spaces on Wiener space and for 
standard notation, we refer the reader to [13]. 

We denote by D the derivative operator. If X is a simple functional with 
values in H, DX is a random variable with values in L 2 ([0, T\; H d ) and 
can be viewed as a nonadapted process (DjA)o<t<T- We will say that a 
functional (or random variable) X with values in H is smooth, if it can 
be written as a finite sum of multiple Wiener integrals with continuous 
deterministic integrands. Note that if X is smooth, the process (DtX) has 
a right-continuous modification. We denote by S a ([0,T]; H) the space of all 
adapted processes {Yt)o<t<T with values in H, with continuous paths such 
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that, for each t G [0,T], the random variable Yj is smooth in the previous 
sense. The space S a ([0,T];H) is dense in L%([0,T\;H) for all pG [l,+oo). 
Our regularity assumptions on a and can now be formulated as follows. 

Assumption A2. For 7 = a and 7 = (3 and for all Z G S a ([0,T];H), 
the process 7*(Z) is in B 2,2 and, for all u,v G [0,T], there exist operators 
denoted by A/y*, ^>Lt*> such that > for z e S a([0,T];H), 
D u fr*(Z)) = (D ul *)(Z) + ~/*(D u Z), 
Dl(Y(Z)) = (D 2 uvl *)(Z) + (D ul *)(D v Z) 
+ {D vl *){D u Z) + 1 *{Dl v Z). 

Moreover, these operators satisfy the following estimate, for all q\, #2 with 
1 < Qi < Q2 < 2: 

/ rT \ 1/<?1 

E / |D„ 7 *(Z)(t)|« + |Ai,7*(Z)(*)l«' dt) 

(12) W ° ^ 

/ rT \ l/?2 

<c, li52 fE y o \z t \^dt) , 

where the constants C qim do not depend on u,v (or Z). 

The estimate (12) for a and /? allows us to extend the operators D u a* , 
-D^a*, D u (3* , D^vft* as continuous operators from Lf ([0, T]; if) into 
L^ 1 ([0, T]; i?), for 1 < qi < qi < 2. Note that in typical examples [see Sec- 
tion 3.4, (21), (22)], the operators D u a* , D u (3* are not bounded from 
LP([0,T]; H) into itself. In the sequel, it will be convenient to use the fol- 
lowing notation. For a random variable Z in B 2 ' 2 , and u,v G [0,T], let 

n{Z,u,v) = \Z\ + \D U Z\ + \D V Z\ + \D 2 UV Z\. 

Proposition 6. Let Assumptions Al and A2 hold. Let F G L 2 ([0, T]; #). 
We assume that F has a modification Ft such that, for each t G [0,T], 
F t G B 2 ' 2 and sup 0<M V<T E J n(F t , u, v ) 2 dt < 00. Then, the solution of (11) 
has a modification 9f satisfying, for 1 < p < q < 2, 

f [T / rT \l/q 

EJ n p (9 t ,u,v)dtj <K P)q [EJ n q (F t ,u,v) dtj , 

where the constants K p ^ q depend on T and the constants C p and C qim in 
Assumptions Al and A2 (and not on u,v or F). 

For the proof of Proposition 6, we will need the following commutation 
relations between the operators J and the derivative and conditional expec- 
tation operators. We omit the proof which involves only classical arguments 
of analysis on Wiener space. 
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LEMMA 7. For all X £ B 1 ' 2 (H), we have 

D u (J(X)(v)) = J(D u (X))(v)l {u < v} and 
D u (E(X\F v ))=E{D u (X)\F v )l {u < v} , dudv a.e. 

PROOF of Proposition 6. The formal differentiation of (11) gives 

D u 9 t = D u F t + (D u a*)(j(£e s d s y)(t) + (D u f3*)(E^J T 9 s ds\^ (t) 

+ a* (d u ( j ^ e s ds^j ))(*) + F (d u (e (^J T e s ds\^yt). 

Using Lemma 7 and the linearity of D u , we get 

D u 9 t = D u F t + (D u a*) (j(J 9 S ds^j (t) 

+ (D u (3*)(e(J T 9 s ds\F^j(t) 



(13) 



+ a*(± [u , T] jU D u e s ds\){t) 
+ (3* (l [u ,r|E ^ D U 9 S ds\f\\ (t). 



Now let I Ut T be the operator on L^([0,T]; H) defined by 

I UjT (Y) = t [UiT] Y. 

Clearly, is a self-adjoint operator and defines an operator with norm 1 
on LP([Q,T]; H) for every p S [l,+oo). We have 

a* o I u T = (I u T o a f and (3* o J uT = (J U)T o /?)*, 

and the operators I^t o a and o /3 satisfy Assumption Al with the same 
constants C p as a and (3. Now let ^4 U and B u be the operators defined on 
LP([0,T];H) (p>2)by 

i=i Jo 



B„(y)(*) = J l [u , T] (s)[3(Y)(s)ds. 
Using Proposition 3, we can rewrite (13) as 

D u e = (j) u + (A* u +B*)(D u e), 
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where cj) u is the adapted process defined by 

<j) u {t) = D u F t + (D u a*)(jU 6 s d s yj(t) 

+ (D u f3*)(E^J T 9 s ds\^yt). 

It follows from Proposition 1 and the properties of the operators I u t ° ol 
and I U: t P that, for p 6 [1,2], 



E F \D u 6 t \ p dt<C p E [ T '\Mt)\ p dt, 
Jo Jo 



where C p does not depend on u. On the other hand, we deduce from As- 
sumption A2 and the assumptions on F that, for 1 < p < q < 2, 



E J* \4> u {t)\ p dt\ ^ <C P (e £\D u F t \ p dt\ 



+ C P J ( E 



T 



1/p 



Jt e„ds 



1 \ 1/9 

dt 



+ E 



T 



E / fl^ds 



3 \ V? 

dt 



where here again the constants C p and C Pj(? do not depend on u. Here we have 
used the notation Jt{Z) for J{Z){t). We have, using Jensen's and Holder's 
inequalities, 



E 



E / 6 q ds 



Ft 



i \ i/? 
dt I < ( E 



9e ds 



3 \ 1/3 

dt 

1/3 



On the other hand, using 1 < g < 2 and the BDG inequality, we have 



E i) J< (i) ^ 



<T l/,-l/2/ E 



3 \ 1/3 

dt 

T 



T 



< T yi-v>c q \E 



<t 1 / 2 cJe l T \e,\ q ds 



e s ds 

<?\ 1/3 
1/3 







6>, ds 



2 N 9 /2 N 1/9 

dt 
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Recall that 9 = (I — A* — B*)~ 1 (F), so that 

r T \ 1/g / r T \ 1/g 



f 1 \ 1/q f f 1 

E J \9 t \ q dtj < C q \E J \F t \ q dt 



Hence, we have, for 1 < p < q < 2, 

rT \l/p f rT \l/p f rT \ 1/g 

EJ \D u 9 t \ p dtj <C P \EJ \D u F t \ p dtj +C Ptq \Ej \F t \ q dtj , 

where the constants C p and C Ptq depend on T but not on u. We can now 
differentiate (13) with respect to v and derive in a similar manner the esti- 
mate 

l/p / rT \ l/p 



E 



J \Dl v O t \ p dt\ P <C p (eJ o \D 2 uv F t \Pdt 

+ C M Uj\\F t \ + \D u F t \ + \D v F t \) q dt 



i/g 



Note that in order to justify the formal differentiations, it suffices to use an 
iterating procedure of the form 9 = F and 9j + \ = F + (A* + B*)(9j). The 
regularity of Oj carries over to 9j + \ and we have convergence of 9j toward 
9, together with the derivatives, with the suitable norms. □ 

For the application of our methodology to numerical schemes, we will 
need to consider families of operators (a h , (3 h )h>o an d introduce some addi- 
tional notation. Let Ai t % denote the space of all operators (a,j3) satisfying 
AssumptionsAl and A2. For (a, (3) £ Ai t 2, let C p (a,f3) [resp. C qim (a,(3)] be 
the smallest constant for which (4) [resp. (12)] holds. The following propo- 
sition follows easily from Proposition 6. 

Proposition 8. Assume (a h , (J h )h>o is a family of operators in Ai t 2, 
satisfying, for all p £ [2, +oo) and for all q\,q2 with 1 < q\ < q2 < 2, 

lim C p {a h -a, (3 h - (3) =0 and lim C qi q2 (a h - a,(3 h - (3) = 0. 

If (i ?h ')h>o is a family of adapted processes satisfying sup 0<u v<T K J T n(F/ 1 , 
u, v) 2 dt < oo and 

lim sup E / n(F t h - F?,u,v) 2 dt = 0, 
h ->°0<u,v<T JO 

then the processes 9 h [defined by 9 h = (I - A* h - Bl)- 1 (F h )} satisfy 

rp 

Vp€[l,2) lim sup e[ n(9\ - 9^,u,v) p dt = 0. 

h ^°0<u,v<T JO 
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3.4. Application to the Euler approximation of delay equations: the regular 
case. In this section we assume to simplify the notation that all processes 
take values in R. We are interested in the expansion of E/(Xr) — E/(Xy) 
where the process (Xt)te[-r,T\ solves the stochastic delay equation 

dX t = a^J° X t+s du{s)^dW t + b^J° X t+S dv(s)^dt, t>0, 

X s =i s , se[-r,0), 

where r > 0, £ G C 1 ([— r, 0],R) and u is a finite measure. 

We denote by X the following Euler approximation of {Xt)t^[~ r ,T] with 
step h = r/n: 

dX t = a(^J X v{t)+r]{s) du{s) S jdWt+b(^J X ri{t)+v{s) dv(s)^j dt, t>0, 

X s = £ s , s€[-r,0], 

with r](s) = ^jjjr , where [t] stands for the entire part of t. We assume that 

the functions, /, a and b are in C^. Note that if v is the Dirac measure at 
0, we have a standard diffusion. 

For existence, uniqueness and moment estimates of solutions of stochas- 
tic delay equations in the above form, we refer to [12]. Consistency of the 
Euler scheme for delay equations in the case where v is a Dirac mass has 
been studied in [9] through an extension of the PDE method. An infinite- 
dimensional extension of the PDE method is used in [4] but their result is 
limited to drift coefficients linearly dependent on the past and nondelayed 
diffusion coefficient. 

Our expansion result is derived from the duality formula and the following 
lemma. 

Lemma 9. Let (Ug) be a family of Tt -measurable real-valued processes, 
such that V s G [0, T] , V h G [0, 1] , G D 1 ' 2 . We assume that, for some p > 1, 
we have 



limE [ T \U!? - U°\ p ds = 

/w0 Jo 



and 



lim / / sup \\D v Ul l - D s+u U®\\pt ri{s)+rj <y l >odsdv(u) = tt. 

n^vJ-rJo v€[r)(s)+r)(u),s+u] 

Then 

rh rv Y . \ J,.l„.\ A„ — Ur<(TT®\ I Th(TT®\ 



10 



E/ U? (X s+u -X v[s)+1l{u) )du( U )ds = hC(U l> )+I n (U {> )+o(h), 
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where 

C(U°) = \(\ [ T [U°(b s+u t s+u > + £ +u l s+u< o) 

J —r JO 

+ a s+u D s+u U® t s+u >o] ds du(u), 
I\U G ) = j\£[U°(b s+u l s+u >o + e s+u l s+u <o) 

+ a° +u D s+u U°t s+u >o] ds(u - i](u)) dv{u), 
bt=b(J° X t+V dv(vf) and er° = a^J° X t+V du{v)^j . 

Remark. Observe that \I h (U°)\ < hC. Moreover, when v is a Dirac 
mass at — r a good discretization of the time interval gives I h (U°) = 0. When 
v is an absolutely continuous measure, we obtain I h (U°) = hC(U°) + o{h). 

Proof of Lemma 9. We have 

/ rs+u rs+u „ \ 

X s + U - X„( s 14_„Cm1 = / cLm dW t + / dt t 



s+u ~ ^ v (s)+r,(u) - I / O^(i) aw t 1- U v ( t) Ui j lL v (s)+ V (u)>0 

\J r)(s)+r)(u) J r](s)+ri(u) 

+ (£,s+u - €r)(s)+ri(u))^s+u<0 

+ (£o — ^,ri(s)+ri(u))^-rj(s)+r](u)<0<s+u: 

where 

(14) a? = a(£x t+rl{v) du(v) 
and 

(15) ~b^ = b(J^X t+ri{v) du(v)y 
This gives 

f T f° - 

E U s (X s+U - X^ (s)+77 ( u) ) du{u) ds 

JO J —r 

r T rs+u 



/U rl rs+u 

E U*l v(s)+V{u) > a\ t) dW t dsdv{u) 
-r JO Jr)(s)+ri(u) 

rO rT rs+u 

s )+ v (u)>o / b^dtdsdviu) 

J —r JO Jri(s)+T](u) 
rO rT 

+ / E / Us(£ s+u -£ v ^ +v ( u })l s+u<0 dsdi;(u) 

J —r JO 
rO rT 

+ / E / U s (£ - ^j ? (s)+77(u))lr/(s)+r/(u)<0<s+u dsdv(u). 
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By duality, we obtain for the first term 

ps+u 

L ri(s)+ri(u)>0 



pT 

E / Uhr 

-r JO 



pT 

E / 1 



r JO 



■n(s)+v(u) 

s+u 



r/(s)+??(«)>0 



ri(s)+ri(u) 



D tUs^{t) dtds dv{u). 



Since r/(s) + 77(11) < < s + it implies — u < s < —u + 2h, one can easily verify 
that 

E / f^s (£0 -£rj(s)+?7(u))l?7(s)+?7(u)<0<s+ud sc M«) = o(h). 
r JO 

Now recall that if g is an integrable function on [0, T], we have Jq g(s)(s — 
T)(s)) ds = t| Jq g(s) ds + o(h) . It follows that in order to derive the expansion 
stated in the lemma, it is enough to prove that when h tends to 0, 



(16) 



pT , 

E U h s 

-r JO 



s+u 

rj(s)+r)(u) 
T 

r 0I0 
J s+i 



6^ dtds dv{u 



E / UX+u&s+udsdv(u 

r JO 



(17) 



pT ps+u 

E / 

-r JO J rj(s)+r](u) 



D t U h s a^ {€) dtds dv{u 



rT 



E / d v s+u D s+u U [ >A s+u dsdv(u 

r JO 



(18) 



pT 

E U } s 

-r JO 



s+u 



il(s)+r)(u) 



s+u<ods dv{u 



y E ^ U^' s+U l s+U<0 A S+U ds du(u 



where A s+U = s + u - r)(s) - rj(u) , U h s = t v (s)+v{u)>o and U° s = U°l s+U > . 
Using Holder's inequality, the left-hand side of (16) is bounded by 



\U* -U?\\ p d8 sap \\%\\ q 
t 

+ \\Us\\pdssup sup \\b^ {t) - b° s+u \\ 

JO u,s t £[ri(s)+ri(u),s+u] 

f T h ~h 
+ SUp / \\U S ||pln( s )+„(u)<o<s+u^ ssu P||^ llgi 
u Jo t 
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with p + q = 1 - 0bserve that suPuJo \\Us\\pl v ( s )+ v (u)<o<s+ u dsswp t \\b$\\ q = 
o(h). In the same way the left-hand side of (17) is bounded by 

/ / sup \\D t u!} - D s+u U®\\ p t n ^ +v( ^> dsdv(u)swp\\a% \\ q 

J-rJO te[ri(s)+r](u),s+u] t 

+ / / \\D s+u Us\\pdsdv(u) sup sup ||c& t) - cr° + „|| 
J-rJO u,s te[r](s)+rj(u),s+u] 

+ o(h). 

Similar bounds hold for the left-hand side of (18) and we obtain the result 
of Lemma 9 as soon as 

sup ||6^|| g <oo and sup \\cr s \\ q < oo, 



h>0,s&[0,T] h>0,se[0,T] 

h - Pr° II 
n(t) °s+u\\q 



sup sup \\ab t) - er? + JL 



u ' s te[r](s)+r](u),s+u] 

and 

sup sup ||6j (t) -&2+JL->0, 

«> s te[r)(s)+r)(u),s+u] 

for all q £ [l,+oo). This can be proved as in [6]. □ 

The following theorem can be viewed as an analogue of the classical ex- 
pansion of the error for diffusions (see [15]). 

Theorem 10. We have, if f eCf, 

E/ (X T ) - Ef(X T ) = hC f + I h (f) + o(h), 
where C f = C{U°) and I h {f) = I h (U°) are defined as in Lemma 9 with 

U ° =<T '{f X s+udu{u]\D s f'{X T ) + b'(j^ X s+u du(uf)f'(XT) 

+ <r / (/° X s+u du(u)^D s ^ 9 t dtj + b'(^J° X s+U du{u) \ J\ t dt 
and 9 is the unique solution of 

0t = a* (j (f'(X T ) + £ S ds^j ) (t) + (3* (e (f'(X T ) + J T e s ds\^ (t) 
with 

a*(X)(t)=K( f° a'( f° X t _ u+V dv{v))x t - U dv{u) r\ 

\Jm&x(t-T,-r) \J-r / / 

0*(X)(t) = e( f° b'( f° X t _ u+V dv{v))x t - U dv(u) r\ 

\Jmax(i-T,-r) \J -r / / 
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PROOF. We have 

Ef{X T ) - Ef(X T ) = E f 1 f(aX T + (1 - a)X T ) da(X T - X T ). 

Jo 

Let F h = Jd f(aX T + (1 - a)X T ) da and Y t = X t - X t . We have 
fo (/ Xs + udv ^) ~ X v(s)+v{u) dv{u)^j 

= b i(s) J {X s+U - X v{s)+r)iyU) )dv{u) 

and 

°"(/ Xs + udu ( u )) ~ a (J X v(s)+v(u) d "( u )J 
= cr 1 (s) y (X s+u -X^ s)+7?(u )) 

where 

(19) oy(s) = ^ cr' (a J X s+U dv(u) + (1 - a) ^ -X^( s)+>/ ( u ) da, 

(20) 6?(s) = J b' (a y° Z s+U aV(u) + (1 - a) J° X vis)+r){u) du{u)^j da. 

We deduce that Y t is a solution of 

dY t = a h (Y){t) dW t + (3 h (Y){t)dt + dG l t, t>0, 
Y s = 0, se[-r,0], 

with 

(21) a h {Y)(s)=a h l {s) (° Y s+U dv{u), 



(22) /? fc Cn(s) =6f(s) [° Y s+U du(u), 



Gt= / »fW / {X s+u -X v{s)+r){u) )dv{u)dW s 

JO J —r 

ft f0 

+ b\{s) (X s+U - X v{s)+r){u) )dv{u)ds. 

JO J —r 

The operators a h and (3 h satisfy Assumption Al uniformly with respect to 
h. The adjoint operators a h * and (3 h * are given by 

a h *(X)(s) =e( [ ofta - u)X s . u dv{u) F s ) , 

\Jmax(s-T,-r) J 
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(3 h *(X){s)=E( f° b\{s-u)X s - u dv{u) F a ). 

\Jmax(s-T,-r) / 

They satisfy Assumption A2 uniformly in h. Note that the estimates on 
D u a h * , D u p h *, and so on, follow from the boundedness of the derivatives of 
b and a and the following estimates (see [6]): 

Vp£[l,+oo) sup En p (Xt,u,v) < oo and 

0<u,v,t<T 

sup sup En p (X t , u, v ) < oo. 

h>0 0<u,v,t<T 

Using Theorem 4, we obtain 

Ef(X T ) - Ef(X T ) = EF h Y T = EF h G^ + E / 6^G h s ds, 

Jo 



with 



But 



6 h = {I- {A h f - {B h yy l [a h *{J{F h )) + (3 h *(E(F h \F.))] 

EF h Gt = e£ D s F h a\{s) J° (X s+U - X v{s)+ri(u) ) dv{u) ds 
+ E f 7 F h b>{(s) f\x s+u -X n{s)+ri{u) )du{u)ds 

JO J —r 



and 



E^ 6 h s G h s ds = Ej^ Z> fl Qf eUfyi{s) j_{X s+u -X v{s)+v{u) )dv(u)ds 
+ Ej 7 f^J 7 Q h t dtj b>£(s) J\x s+ u ~ X n{s)+V{u) )dv(u) ds. 



We end the proof applying Lemma 9 with 

rT 



U s h = D s F h a } ±{s) + F h b\{s)+D s (^J^ Q h t ■ dtj o£(a) + b\ \s) J Q h t dt. 

Since lim/ l sup 0<u ^ t<T En p (A'j — X t ,u,v) = for p > 1, the convergence of 
Ug and its derivatives follows from Proposition 8. □ 



4. The irregular case. 
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4.1. Duality for the derivatives ofY. In this section we want to establish 
duality formulae similar to those in Theorem 4, for the derivatives of the 
solution of (3). This is motivated by the treatment of irregular functions of 
the Euler scheme, which will involve integrations by parts (see Section 4.2). 

We will need regularity assumptions on the operators a and (3. We will 
assume that for Z G S a ([0,T];H), a(Z) and j3{Z) are in B°° and that we 
can define recursively the operators s a and D^..^ (3 so that, for k > 1 
and s 1} ...,s k e [0,T], 

D Sl ((D k s -} Sk a)(Z)) = (D k Sl ... Sk a)(Z) + (D k -}. Sk a)(D Sl Z), 

D Sl ((D k s -}. Sk P)(Z)) = (D k Si ... Sk P)(Z) + (D k s -} S J)(D S1 Z). 

Note that D* . Z* can be viewed as an element of H dk , with coordinates 
D l s \ ...g fc fc , where the /j superscripts refer to the coordinates of W with respect 
to which differentiation occurs (li = 1, . . . ,d). We now introduce the following 
assumption. 

Assumption A3. For 7 = a and 7 = f3, the operators Di 1 ... Sj 'j defined 

above are bounded from L|([0,T];F) into Lg([0, T}; H d3 ') for 2<p<q< 
00. Moreover, their adjoints satisfy the following estimates. For all positive 
integers j and for 1 < p < q < 2, there exists a positive constant C Pt qj such 
that for all u, v, s\, . . . , Sj S [0, T] , we have 

II (^i-.^T)*!!^ + II^(^ 1 ... s ,t)*II^ + II^C^I-^t)*!!^ < c-^-, 

where || • > p stands for the operator norm from L q a into and the op- 
erators D u (D J Sl ... Sj ^f)* , Du V (D J Sl ... Sj ~/)* are defined in the same way as D u ^y* 
in Assumption A2. 

Recall the notation 

n(Z,u,v) = \Z\ + \D U Z\ + \D V Z\ + \D 2 UV Z\. 



Theorem 11. Let Assumptions Al, A2 and A3 hold. LetG= (Gt)o<t<T 
be a continuous adapted process with values in H , satisfying Gt £ B°°, for 
all t G [0, T]. Then the solution of (3) satisfies Y t G B°° , for t G [0, T\. 

Moreover, given an adapted process F = (F t )o<t<T with values in 
L 2 ([0,T] k ;H dk ) such that F t G B 2 ' 2 for t G [0,T], and 

sup E/ n (F t (si,...,s k ),u,v)dt) < 00, 

o<u,»,si,..,s li <r\ ^0 / 
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there exist adapted processes (9(°\...,<9^,...,6>( fc ) ; with values in H,..., 
U>([0,T]i;H d:i ),...,U>([0,T] k ;H dk ) respectively for all p G [1,2), such that 

(23) E f T (F t ,D k Y t )dt = J2^ C \oP,D*G t )dt, 

and, for 1 < p < q < 2, j = 0, . . . , k, 

E F n p {0 [ t j \s 1 ,...,s j ),u,v)dt 



Jo 



sup 

u,v,s 1 ,...,s j £[0,T] \ Jo 

(24) 



<C p . q , k sup (e j n q (F t (s 1 ,...,s k ),u,v)dt) , 
u,v,si,...,s k £[0,T] V Jo / 

where the constants C Pyqj k do not depend on F. 



Corollary 12. In addition to the assumptions of Theorem 11, we 
assume that the process (D k Gt) is right- continuous with respect to t for 
k>l. Then, if Y is the solution of (3), the process (D fc Yt)o<t<T has a 
right- continuous modification. Moreover, given a random variable <3? with 
values in L 2 ([0, T] k ; H dk ), such that $ G ID) 2,2 and 

sup En 2 ($(si, . . . , Sfc), u, v) < oo, 

M,D,Sl,...,S fe e[0,T] 

i/iere exist adapted processes (9(°),...,<9^,...,0( fc ), with values in H,..., 
LP '([0,T]J;H d - '),..., U '([0,T] k ;H dh ) respectively for all p G [1,2), suc/i t/iai 

(25) E($,D fc F T )=E($,L> fc G r ) + VE / {§[ j) , D*G t ) dt, 

and, for 1 < p < q < 2, j = 0, . . . , k, 

sup (e [ n p (§ i t j \s 1 ,...,s j ),u,v)dt) ^ 

u,v,s 1 ,...,Si£[0,T}\ JO J 

(26) 

<C P ,g,fc sup (En 9 ($(si,...,s fc ),ii,t;)) /<? , 

«,«,si,...,s t e[0,T] 

where the constants C p „k do not depend on <£. 

PROOF. By differentiating (3) k times, we get 

D k Y t = D k G t + f D k {a{Y){s))- dW s + f D k ((3(Y)(s)) ds + i? } , 
jo Jo 
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with 



4 k \ Sl , ..., Sk ) = E D V-^-sM Y ^) 1 ^<th 

i=l 



where the notation Sj means that the variable Sj is omitted. More precisely, 
recall that D k . Yt can be viewed as an element of H dk , with coordinates 

^si'-'-a/t ' wnere the /j superscripts refer to the coordinates of with respect 
to which differentiation occurs. With this more precise notation, we have 

/^'"^Oi, ...,s k ) =^Dl\;fg\(ai i (Y){s i ))l {s .< t} . 
i=l 

We can write 

Dt.. Sfc y i = Gf ) ( Sl ,..., Sfc )+ f a{D k Sl ... Sk Y){s)- dW s 

(27) 
with 

G { t\s 1 ,...,s k ) = D k Sl ... Sk G t + Y J E f{Dla){D k s ^Y){s).dW s 

j=i T€A k J0 

(28) 

Jo 

where A k is the set of j-tuples r = .. with 1 < i\ < ■ • • < ij < 
s T = • • • Sj. , and f is the ordered complement of r. We deduce from (27) 
that Dg x . Yt solves an equation similar to (3) and we can derive L p — L q 
estimates for the derivatives of Y using Assumption A3 and the regularity 
of G. Here again the formal differentiation can be justified by a standard 
approximation argument. 

We now prove (23) by induction. For k = 0, the result reduces to the first 
part of Theorem 4 and Proposition 6. Now assume that (23) and (24) hold 
up to the order k — 1. We first deduce from (27) that 

(fc) fl (fc)\ 



E f (F t ,D k Y t )dt = E f (G { t k \9r>)dt, 
Jo Jo 



with t (fc) (si, . . . , s k ) = (I- A* - B*)' l (F( Sl ,. . . , s k )). The estimates for 0( fc ) 
follow from Proposition 6. It follows from (28) that 

E {Gf ) ,0f ) )dt = R {D k G t ,6 ( t k) )dt + R T , 
Jo Jo 
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where Rt is the sum of terms which are of three types, which we study 
successively. 

Type 1. 

E Jo dt J[OT]* dh ' " dtk ' ' ' (/^ ■t J «)K^...*^)(«)- dW.^, 



with j > 1. We have 

r 

lo J[0,T] 

dti ■ ■ ■ dt k 



E Jo dt JoT* dh "' dtk i 9 ^^ 1 ' ■ ' ■ ,tk) ' {jl^...t^){D k t -^.. . t Y)(s) ■ dW s ^ 



'[0,T] 



k 



xE^dt^ih, . . .,t k ), ( j\Dl.. t] a)(Dl + l.. t Y)(s) ■ dW ; 



with 



/ dh---dt k E [ {9 s (t ll ...,t k ),D^ 1 ... tk Y s )ds, 

J[0,T] k JO J + 

^(t 1 ,...,t fc ) = (^ i ... tfc a)*(j^ T ^)(t 1 ,...,t fc )d S ^(t). 



Here, we have used Proposition 3, with D\ x ,„i ,a instead of a. Using As- 
sumption A3, we have, as in the proof of Proposition 6, 

ME jf n p (e t (ti,...,t k ),u,v)dt) 

< C p>g U £ n 9 (#f } (h , . . . , t k ) , u, v) dt) , 

for 1 < p < q < 2. We can now apply the induction hypothesis, for a fixed 
t±,...,tj, to the process dt {t\ , . . . , t j ) considered as a process with values 
in L p ([0, T] fc ~ J ; H d J ). Note that these processes are not in L 2 but, by a 
suitable density argument, the induction hypothesis can be applied. 



Type 2. 
E [ dt 



dh--- dt k (ei k \t 1: . . .,t k ), /K/>f V)(*; ds^, 



10 J[0,T] k 

with j > 1. We have 

E f T dt j 

Jo J[o,T] 



dh--- dt k (el k \t u . . .,t k ), ([ii>i : .., m/>f..;. ,, vif.) ds^j } 
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[0,T] k 



dt\ ■ ■ ■ dtk 



[0,T] 



rft(e t (<i,...,t fc ),D^...t fc r t ) > 



(*i,--.,tfc) = {K-tJT\H / . . . ,t k ) ds t. ) ) (t). 



with 



Here again, we have used a variant of Proposition 3, with D J ti ... tk (3 instead 
of (3, and the LP — L q estimate follows from Assumption A3 as in the proof 
of Proposition 6. 

Type 3. The terms of type 3 come from l( k ' . They are of the following 
form (we let 6 = 9^): 



E / dt I dsi ■ ■ ■ dsk 

Jo J[o,T] k 

x ;/^.', ,n)(/^ ;'_r)i.,):,., t} t ( si> ..., Sj ,..., Sk )) 

and can be treated as follows (the notation /[ t jh dsj means that integra- 
tion with respect to Sj is omitted): 

E / dt dsi ■ ■ ■ dsk 

Jo J[o,T] k 



[0,T]* 



dsj 



xE / d Sj / ^<0 t ( Sl ,..., Si ,... )Sfc ),(I)^ 



[o.T]*- 1 Jo 



(^(^J Qu(si,-,s,-,Sk)du J 
/ ds'jE / (0 t (si,...,Sj_i,s 3 - + i,...,sjfc),i5*~ J „. a y t )di, 

./[O.T]*- 1 JO J + 
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with 

6 t (si, . . . , Sj-i,Sj + i, . . . , Sk) 
/ / r T 

> s j-i> ■■> s i+i> • • > s k) du T. ) ) (i). 



Pl"Vi a )*( E (/ T ^( si '---" 



We have, using Assumption A3, 

rT _ \ 1/p 

|6< t (si, . . . , Sj_i, Sj+i, . . . , S k )\ P dt 



E 



<C P ,,(E 



<C Pi9 [E 



^ E^ u (si,...,s J _i,t,s J+ i,...,s fe )du ^ 



9 \ 1/9 

dt 



T 



s (si, . . . , Sj_l, t, + • • • , Sfc) ^ s 



dt 



i/a 



<C Pt gT SUp (e / |6> s (si,...,Sj_l,i,Sj + l,...,Sfc)| 9 ds 
0<<<T\ JO 



Finally, we have Ej^(F t ,D k Y t ) dt as a sum of terms like E Jq (6 ( t j) , D^G t ) dt, 
with j < k, or E Jq (F^, D l Yt) dt, with i < k — 1, with appropriate estimates 
for the processes F«. We can now apply the induction hypothesis to terms 
like E/ T (F t (i) , J D i y t )di. The various #'s given by the induction hypothesis 
combine to produce the final form stated in Theorem 11. □ 

Proof of Corollary 12. The continuity of the derivatives of Y follow 
easily from the assumptions on G and (27). Using the notation of the proof 
of Theorem 11, we have 

E{$,D k Y T ) =E($,G<r ) ) +e($, £ a(D k Y)(s) ■ dW s + £ (3(D k Y)(s) ds^j 

= E($, d?) + E [ T ( a *(J($))( S ),D k Y s ) ds 
Jo 

+ E [ T {/3*(E(<P\^.))(s),D k Y s )ds. 
Jo 

For the last two terms, we can apply Theorem 11, and the fact that, for 
l<p<q<2, 

rT \ 1/p 



1/9 



E ^ n%7 t (*(*i---a fc )),it,i0<ft) <C P!q (En q m Sl ---s k ),u,v)y 
i 

/■T \ 1/p 

E ^ n p (E($( Sl --- Sfc )|^ t ),n,t>)^J < C7 M (En 9 ($( Sl • • • s k ), u, v)) 
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For the first term, we have, using (28), 

E($,G$5°> = E{<S>,D k Y T ) +R T , 

where Rt is a sum of terms of three different types, which can be treated 
in the same way as in the proof of Theorem 11. □ 

4.2. Application to the Euler approximation of delay equations: the irreg- 
ular case. In this section we consider the processes X and X of Section 3.4. 
We assume that / is a measurable bounded function, b and a are in C%° and 
that the variable Xt is nondegenerate: 

(29) E(( 7XT )- p )<oo Vp>l, 

where 7x T denotes the Malliavin covariance matrix of Xt- This condition is 
satisfied in the uniformly elliptic case, that is, cr(x) > a > for all x £ K (see 
[10]) and under weaker assumptions (see [2]) when v is a Dirac measure. 

Theorem 13. Forb and a inC^° and Xt satisfying (29), we have for 
f measurable bounded: 

\Ef(X T )-Ef(X T )\<C f h. 

Sketch of proof. We consider the following truncation function. Let 
: [0, +oo) Mlbea C°° function with bounded derivatives such that l[o,i/8] — 
* < 1 [o,i/4] an d let 7x T be the Malliavin covariance matrix of Xt be which 
in our one-dimensional setting reduces to jx T = Jo \d u Xt) 2 du. We define 
by 

fT(D u X T -DjC T )*du* 



(30) ^ T = * 

Observe that 



7x 2 



P(tf£ / 1) < p( 7 jg, J (D U X T - D U X T ) 2 du > 1/8 
< 8 p E-y x P T U\d u X t - D U X T ? du 



for all p > 0. Using Holder's inequality and sup u E\D U X T - D U X T \ P < ChP/ 2 
one can easily prove that for all p > 1 

(31) ¥{¥ T ^l)<Ch p . 

Moreover, we have 

+ 0} C \J\d u X t - D u X T fdu < 7x T /4}. 
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Since 

laX T+{ i-a)x T > lx T /2 - (1 - af [ T (D U X T - D u X T f du, 
we obtain for < a < 1 

(32) + 0} C {i aXT+{l . a)XT > \ix T }. 
Now we have 

Ef(X T ) - Ef(X T ) 

= E{(f(X T ) - f(X T ))(l - *$,)} + E{(/(X T ) - f(X T ))^ T }. 

By construction of the first term is of order h p for all p > 1 and we just 
have to prove that the second one is of order h. 

Let Yt = Xt — Xt and let (/ m ) be a sequence of C 1 functions such that 
||/m||oo < ll/lloo and (/ m ) converges dx a.e. to /. We have 

E(f m (X T ) - f m (X T ))* T = [ Ef m {aX T + (1 - a)X T )Y T ^ T da. 

Jo 

Since Xt admits a density E/ m (Xr)^j, converges to Ef{Xx)^ T - Now on 
the set {& T ^ 0}, detjx T > and from [13], Corollary 2.2.1, page 88 (see 
[3] in higher dimension) Xt has an absolutely continuous law conditioned 
by {^ T / 0} and Ef m (XT)^> T converges to E/(Xr)\l/y. It remains to prove 
that E(/ m (Xr) — f m (XT))^T ^ s bounded by Cfh where the constant Cf 
only depends on / through ||/||oo- Using the Malliavin integration by parts 
formula (see [14]) we obtain 

E(f rn (X T ) - fm{X T ))^ T 

= f 1 Eg m (aX T + (1 - a)X T )H 3 (aX T + (1 - a)X T ,Y T V T ) da, 
Jo 

where g m (x) = f£ dy $ dz f m (z) so that g m is in C 3 and g'^ = f m and H 3 is 
defined recursively by 

H 1 (F,G) = G 1f 1 5{DF) - {D(G 1f 1 ),DF), 

H k {F,G) = H 1 (F,H k -i(F,G)), k>2, 

with 

{DH, DF) = f T D U HD U F du. 
Jo 

Hence for any measurable set A, we have (see [1]) 

(33) IIFfe^^lAll^CllT^lAlgll^llg^HGIU^ 
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for some constants C, ki, pi, k<i, P2, Q2, P3, Q3, depending on k and p. 
Observe that 



H 3 (aX T + (1 - a)X T , Y T ^) = i?^), 

i=0 

for smooth variables and finally 
E(f m (X T ) - f m (X T ))^ = EV( ^ g m (aX T + (1 - a)X T )^ da, D'Yt 

= Ej2(F^\D i Y T ). 

i=0 

Moreover, the variables F^ h £ B 2,2 and from (33) and (39) we deduce the 
following estimate: 

supEn 2 (F^ h ,u,v) < Ch^XlWaXr + (1 - a)X T \\^, 

u,v 

for some ki, pi, &2, P2, <l2, with C independent of m. Applying Corollary 12, 
this gives 

E(f m (X T ) - f m (X T ))^ = £ (E(F^ h , D i Gx) + £ E [ T (6? J \D*G t ) dt) , 

i=o\ J= o Jo J 

where the process G\ is defined in Section 3.4 by 



G n t = / / (X s+u -X v{s)+ri{u) )du(u)dW s 

JO J —r 

ft f° - 

+ / 6f(s) / 

s)+r?(u)) ^( n ) ^ s 

JO J— r 

* *i (*) / f S+U 5J (W ) dW„ <M«) dW s 

J— r J rj{s)+r](u) 

+ fb1{s) f f +U b h v{v) dvdu(u)ds. 
JO J~r Jr)(s)+ri{u) IK ' 

oy, bi, a% and b% are, respectively, defined in (19), (20), (14) and (15). We 
end the proof using the duality relationship as in Lemma 9. □ 

Remark 14. The above proof carries over to a multidimensional setting. 
The only technical difficulty is to extend the localization argument. Suppose 
Xt takes its values in W with r > 1, and the Malliavin covariance matrix of 
Xt is defined by ( r yx T )i,j = (DXj,, DXj,), 1 < i < j < r. We want to define 
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a smooth functional such that outside a set where all the Malliavin 
derivatives D k ^!j, vanish, we have a uniform control of the determinant of 
the Malliavin matrix of aX T + (1 - a)X T , < a < 1. Let * : [0, +oo) -> R be 
a C°° function with bounded derivatives such that l[o,i/8] < ^ < l[o,l/4]- We 
define ^ by 



where \DX T \ 2 = £ 4 \DX l T \ 2 = J2i, k $o{ D u X t) 2 du and hx T h is the Hilbert- 
Schmidt norm of the matrix 7x T , that is, the I 2 norm of the coefficients. We 
denote by || 7 x T || the operator norm. 

Note that ^ G D°° [the sum of squares of the coefficients (jx T )i,j is 
smooth] and that 



provided \\D(X T - X T )\\ p < C p Vh for all p £ [1, +cxd). 

Now observe that we have the following inequality for any positive-definite 
r-dimensional matrix A: 



W. Now for a£ [0,1], we derive a uniform lower bound for the smallest 
eigenvalue of 7x T +(i-a)x T : 



(34) 





so that for all p > 1 , we have as in the one-dimensional case 
(35) 3C>0 F(¥±y£l)<Ch p , 





inf £ ^D(X l T +(a- " ^)) 



(38) 



> inf y/eixA - SUP £ &^(*T - 



> v /a 1 ( 7Xt )-|D(X t -A > t )|. 
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Moreover, we have 

y {D ^ # o, c { m x T - x T)? < 4(1 + g;^ }. 

But from (36) and (37) we have 

det 7x T Ai(7x T ) 

4(1 + ||t^ t III) ( *- 1)/2 " 4 • 

We deduce that 

[Jp^ + 0} C {|D(X T - A T )| 2 < }. 

Now if |£>(X T - X T )\ 2 < A 1 (tx t )/4, it follows from (39) that 

\/ A i(7x T +(i-a)(x T -x T )) ^ \l^i{lx T )/1 
and consequently, using (37), 

det 7xT+(1 _ a)(XT _ J?T) > A!( 7 x T )74 r > (det7x T )7(ll7x T || r(r - 1) 4^. 
Finally we obtain for < a < 1 

(39) [j{D^ T + 0} C {det 7oXT+ (i- a )x T > ^f0^ }- 

Therefore on the set \J k {D ki f?j, ^ 0}, we have a control of the determinant 
of the inverse of the Malliavin matrix of aX? + (1 — o)Xt by the random 

\hx || r ( r_1 ) 
variable —nrt 

(det 7 Xt ) r 
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